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ABSTRACT 


The time-optimal control functions for sample control systems were 
computed using the iterative computational procedure proposed by L. W. 
Neustadt as adapted for differential analyzer solution. The computational 
procedure investigated was developed from the method of steepest ascent. 
Adaptation for differential analyzer solution required that finite 
sized steps be taken during the ascent vice the infinitely small sized 
steps permissible in theory. This presented one of the problems of the 
computational procedure. No optimization of the step size was attempted 
in this work, however, several criteria for the selection of the step 
Size were used with success on the two-dimensional systems. 

The optimal control functions for two-dimensional systems were 
readily computed using Neustadt's iterative computational procedure. 
Analytic work was performed to verify some computer solutions. Agreement 
of computer and analytic solutions was favorable. The optimal control 
function for the three-dimensional system investigated was not obtained. 
After sixty iterations th*re was no apparent convergence to an optimal 
control function. Some refinement of the computational method used in 
this work would be required to extend the problem solutions to higher 
order systems. No work was performed to determine the effect computer 


errors would have on problem solutions. 





I. INTRODUCTION 


There has been an abundance of literature written concerning the 
classical control problem, i. e., given a control system, assumed to be 
normal, such that 
Ge) X= A(t) ¥ + B(t) U 
where: x represents an n-dimension state vector 

A(t) represents an n x n matrix, not necessarily constant 

B(t) represents ann x r matrix, not necessarily constant, and 

1 represents the r-dimension control vector 
what is the optimal control, 0°, which will drive any arbitrary state of 
the system, X(to)s to some specified final state, x(t,), in the minimum 
time. It is well known that the desired control law is bang-bang and 
is of the form 
G2) a = sgn (BY(t) X1(to,t) ¥) 
where: y represents an n-dimension constant vector 

X(tost) represents an n x n matrix satisfying: 

X= A(t) X , where X(tp,t)) = 1 

Assuming | u; || < 1, where u; are the components of U, then let 
X = B(t) xT(ty,t)} , then (sen & ), = +1, X, > 0, (sen x), = -1, 
x; < 0, and (sgn )s is undefined for CX, = 0, 

Lucien Neustadt published a method for the synthesis of the control 
function which was adaptable to analog computer and digital computer solution, 
refer to L. W. Neustadt, "Synthesizing Time Optimal Control Systems," Journal 


of Math. Analysis and Applications, vol. 1, pp. 8-93, 1963. For the research 





study reported in this paper, the proposed method was adapted for analog 
computer solution, and the regulator problen, x(t, ) = 0, for three 2-dimension, 
time invariant systems, a neutrally stable system, a stable system, and a 
lightly damped system, as well as one 3-dimension, time invariant system were 
investigated with some analytic work developed to aid in the problem analysis. 

The computational procedure for the above mentioned systems as adapted 
for analog computer solution can be briefly outlined as follows: given a 


control system as described by equations (I-1) and (I-2), define 


(1-3) F = H(t 4b) H 
then 
(Ieh) = -F = -aM(t) FT, F(0) = F 


Take some initial guess for y such that 7) 3 x(0) <0, solve this set 
of equations to obtain F(t) from which, using equation (I-2) 

(1-5) w= sgn (BI(t) F(t)) 

Now form the function 

(1-6) f(t, F) = We (H(4,,H) + ¥C0)) 


where by definition 


ty 
(27) z(t, 5¥ ) = J X(to,s) B(s) sgn (BI(s) X1(t,,8)}) ds 
so that + 
(1=<8 ) £(t,51) = : |e" M.S) Bls) | ds + ¥) + x(0) 
0 0 


Determine the stopping time, ty> from the zero crossing of (ca) for 
att . : Oo . 

DS 1h when £(t15))) = 0. Now, 0 < ty < t,° » where the time t,° is 
the minimum time to drive the system to its null state. Obtain the next 
trial value of y from the correction vector 

SS a a > 
CED) Ay = (2(t,,W) + X(0))AT 
where z(t, 1) is obtained by solving 


(I-lo) yr A(t) 7+ B(t) UZ, (0) =0 


. 


~~ OS 





up to the time ty> and then solving backward in time 
(211) w= A(t) W, W(t) = Wt) 
which yields 
(ied) w(0) = 2(t,) 
As long as there is a correction vector, a new trial vector ¥ may be 
used to make t, approach t,° and ¥) to approach ¥ ° where ¥ ° 
is the constant vector which yields the optimum control vector 0°. 

The outlined procedure can be adapted to the more general problem, 
however, the computer capacity required would necessarily be considerably 
extended. For this investigation of the general suitability of the 


computational method involved, it was decided to first investigate only 


the more simple types of problems already mentioned. 





II. STATEMENT OF THE PROBLEM 


Given a control system, assumed to be normal, with constant 
coefficients and a single input, 1) determine the optimum control law 
on the differential analyzer using an iterative technique proposed 
by Lucien Neustadt, 2) investigate the influence of the initial 
choice of the constant vector y , 3) investigate the effect of the 
size of the sampling interval AT, and ) determine whether or not, 
for finite values of AT , the constant vector y might leave the 


domain of 7] 9 1- @., whether or not Y ° x(0) > O for any iterative 


value of nk: 





III. DISCUSSION 


The solution to the classical regulator problem as researched for 
this paper follows with minor exceptions the method presented by Lucien 
Neustadt (Journal of Mathematical Analysis and Applications, vol. 1, 
pp 48h-:93). Given a control system such that 
(aes) Xx = A(t) X(t) + B(t) U(t) 
where: A(t) represents annxn matrix, continuous function of time 

B(t) represents ann x r matrix, continuous function of time 
x(t) represents the n-dimension state vector 
u(t) represents the r-dimension control vector 
what is the optimum control, U°(t), which will drive the system from 
any arbitrary state, x(to), at time tg to some desired final state, 
Ra) at time t, in the minimum time. It is assumed that the admiss- 
ible control is magnitude limited, lu, | <1, and that the system is a 
normal system. A system is normal if any component of BI (t) XT(tost)) = 0 
on any finite interval of time, 0<t<CO , implies 7) = 0, where iF 
is an nedimension constant vector and X(t,t) is the n x n transition 
matrix for 
Carb) x = A(t) X(t) 
satisfying the equations 
(Tite 3) (Ge = A(t) X(t,t,) 
(III-)) X(tosto) = [I 
For such a normal system the optimal control is unique and is bang-bang 


with u;(t) = +1, where the sign is given by 





(III-5) u(t) = sgn (BT(t) xT(t9,t) 4) 

The solution for the system of equations described in (III-1) is given by 
16 

(III-6) B(cya=tx(t,t,) (by) + X(t,t) X(tg,s) B(s) U(s) ds 

so that for x(t) = 0 

(III-7) -x(to) = X(tg,s) B(s) U(s) ds 

t 
Define the subset C(t): 


it 
(111-8) Ce tf X(to5s) B(s) u(s) ds , 2(s) samissitie } 
to 


where C(t) has the properties: 

1) compact and convex 

pT Ce) mae c(t) whenever t > ty 

3) C(t) grows continuously with time 
For t = t,°, -x(0) € c(t,°) and is a boundary point of C(t,°). Since 
C(t4°) is a convex set there is at least one row vector, Yj", such that 
(iim=9) -H°x(0) > Y-@ , forall BE c(t,°) 
Thus A ° a) takes on its maximum value when @ = -x(0), see Figure III-l 


for a two-dimension example. 





Compact Set c(t, °) 


Figure III-l 


— ——.¢ 
@ XS ee @ Hs > © | 


he Seances 650 


2  ——@ 6 eee 2 @ 6. 
See eee 





Now @ € o(t,°)s so that 


fe) 
t1 
(Tre 20) i = X(toyS) B(s) u(s) ds , | u, | =) 
to 
d 
an + O 
(III-11) Y-W = ane X(t.,8) B(s) Ws) ds, Ju, | <2 
18 
@) 
so to maximize ” as Besos unat Ysa = = ¥) « x(0),. les 
(III-12 ) u, = sgn (BI (+t) XT (t,t) Qs 
Now define 
a 
(GamiA'3 ) 2(t4,% ) = (" X(ty,8) B(s) sgn (BT(s) xT(t,,s) ) ds 


0 
so that 2(t,,7) is on the boundary of c(t), see Figure III-2. According 


to equation (III-9) 


(IIT~1h) Y ° B(t,»%) q ° ¢ eetor all ae E C(t.) 5 


> 
id # a(t, %) and the function 7 e @(t,»%) is a non-negative, non- 


decreasing monotonic function of time. 


ay 







—(A(t,.4) +22 (0) 


Compact Set C(t, ) 
Figure III-2 


7, so that -x(0) 


Assuming the origin can be reached in some time, t 


lies on the boundary of the set C(t,°); there is a convex set of vectors, 
Hy, such that if 7 E Ho, -W + x(O) maximizes the function H - @ for 


De c(t,°) and -x(0) = 2(t,°s 7 de Consider the function 





(IIT-15) f(t, 3x(0)) = N+ (@(t,H) + X(0)) 
Now by definition, B(ty»7 ) = 0, so restrict Y such that 
(III-16) f(t ,% sx(0)) < 0 
es y é Hye Oe) 3x(0)) > 0, hence for some time ty» 0 <t,< t_° 
(III-17) f(t,,¥% sx(0)) = 0 
Let 
Games) Cy .x(0)) = ty 
so that 
(IIT-19)  £(F(% ,x(0)), §x(0)) = 0 
Since £(F(Y 5x(0)), 3x(0)) is continuous in its arguments, F(Y 5x(0)) 
must be continuous in ¥) so that if) é Hos (WH ,x(0)) < t,° ange it 
aT E Ho» F(} »x(0)) = ee Thus any vector y such that W +» x(0) < 0, 
which maximizes the time t,, for which Y - (Z(t,,¥) +(0)) = 0 
where 2(t,,¥) is given by equation (TIT<13) may be used in the optimum 
control function. Conversely, if %) defines the optimal control function 
it maximizes the time. 
To solve for ¥ use the method of steepest ascent. Assume 
(III-20)  H= H(%) 
then 
(III-21) ay/at =k VF(H ,x(0)) 
where k > O is some constant or function of TF and Ye In order to 
obtain a valid solution: 
1) F(¥ ;x(0)) must have a maximum for y° 
2) the solution mit) never leaves the domain of a yo) and 
3) the partial derivatives ns exist, where 1, are the 
components of Tio 
Proceeding formally, see Neustadt's work for statements of proof, 


from equation (III-19), given a specified initial state, x(t ), 
0 


8 





where F(Y) ,x(0)) = ty is given implicitly by (III-19). Then 


3 
(i=23)" ae ea) SS) 


but 
(TI=2h) = = (z(t451 ) + x(0)) 
and 
t as 
(III-25) 3 = 2 f Bi(s) x7(t,,8) 7 | ds) 
ue 
so that 


(111-26) 9 VF = -(a(t,,%) + X(0))/ B (ty) XT(tost) 7 | 
From equations (III-18) and (III-20), 
(III-27) Fe FH(T)) 


hence 


(111-28) $6 - See VF 4a 


let 

a _ ll ar i > 
(III-29) ae | Be(t) Xx (to5t) W| Weg 
then 

ay 
III-30 = ~(z(t_,y ) + x(0 
(111-30) Fb = -(2(+,,4}) + ¥(0)) 
so that finally 

= - — ~—> = =x me =< x a 
(III-31) Ms - (a(t, H,) +x(0)) at, 4, - 1,7 4% 
To compute this corrected vector, TW it is necessary to precompute 
B(ty» Y) for which in turn it is necessary to precompute the time ty: 
Thus it is seen that Z(t), 7) is not an instantaneous function of time 
and a finite sampling interval, AT , is required, hence equation (III-31) 
becomes 

= = SS 4 = 
(TII-32) Ny = Wy - (z(t, 4) + X(0)) AT 
The time t, was defined by equation Chideajeand a(t,» Hy) is given by 


equation (III-13) so that we have 





1 
(III-33) Te - 2(t,,%,) of "ie X(t.,s) B(s) sgn (BI(s) XT(t598) I) ds 
0 


or using the steering command given by (III-12) 


—s —_ at t =e 
(IIT-34) -Y, ° (t4544) * f 1 | Bs) xT(4558) %, Il ds 
0 
Now let 


ant =i —_ 
(III-35 ) yo) X (tost) Y 
then 

aL pas =i ak 
TII~36 e Al (t) T(t t_) = 
ua s)s) ae Ce) g(t) , F(t) = NH, 
Solving equation (III-36) then gives re) from which, together with 
equations (IIT-15), (III-17) and (III-3)), it becomes possible to compute 
the time tj. See Figure III-3 for a block diagram description of the 
computing technique. As revealed in Figure III-3, the control signal 
given by equation (III-12) is easily developed at the same time. 

Now with the time ty known it becomes possible to compute 2(t, » ¥),)+ 

Consider 

sea ae = = 
(III-37) yr A(t) y(t) + B(t) ult) , y(0) = 0 


which has the solution 


t 
(IIT-38) y(t) = X(t,t)) J. X(to98) B(s) a(s) ds 


which combined with equations (III-12) and (III-13) yields 

—>, — casein 
(III-39) y(t, ) = X(t, st,) a(t,» Vee 
or alternately 

— = ah =< 
(IIT-),0) 2(t45%) 4) = X (ty sto) y(t,) 
where X(t, sty) is the transition matrix for 
(III-LL)  W= A(t) W(t) , W(t.) = Wt,) 
run backwards in time so that 

= a asilk — 
(IIT=)2 ) w(ty) = X (t, sto) y(t, ) 

aN eS 
= 2(ty> 4) 


See Figure III- for a computational block diagram for the function %(t,,¥],)- 
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TV. COMPUTER DESCRIPTION AND CIRCUITRY 


The analog computer used in the research of this paper was the 
Michigan twenty amplifier computer. The amplifiers had a gain of 
100,000 to 1. Amplifiers were not drift stabilized, however, accurate 
balance was accomplished through use of a 0.1 volt full scale deflection 
voltmeter. Resistors were matched to provide an accuracy of 0.1% and 
capacitors were variable and adjusted to provide matched outputs. 
Twenty-three ten turn helipots plus a three gang helipot were set 
against a null helipot to provide accurate potentiometer settings. 
Individual problems were set up on removable patch boards. 

In addition to the basic computer, a four place digital volt- 
meter was used to read out voltages. Automatic hold switching was 
accomplished by using relays in external circuitry. 

The circuits presented in this section were developed for the 
general two-dimension, single input system: 


AS 
x 


(IV-1) = A(t) X(t) + B(t) u(t) , | ul<1 

The three-dimension, single input system circuitry requires little 

modification and will not be presented in this section. For multiple 

input systems, a normalization scheme other than the one used in this 

work would be required. The specific circuitry for each problem 

analyzed is presented under the appropriate sub-section in Section V. 
Given the system described by equation (IV-1), the adjoint set 

of equations is given by 

(Iv-2) % 0 are gee) at 


as 
ai 


ans 





where 
Aid, -22). 
(Iv-3) AT(t) = ie e 
The circuits required for the solution of this set of equations are 


simple integration circuits as presented in Figure IV-1l, where 


| Aral 
Pater ha Kt 





a x 
eae, ReCr, ae eee a = 


3 3 Fy So t 
P = RC | aoe] 
ho WE, Xt 
and 
P; = potentiometer setting 
R, = input resistance, ohms x 10° 
2 
oF = capacitance, farads x 10-6 
= Sphysical quantity 
€ €voltage representation 
of, = real time 
computer time 
now, 
T ih = 
(Iv-h) —-BI(t) EM(ty4t) H = BL) T 


or for the single input system 
(IV=5) BT(t) X%(t0,t) H = Bt) I 
a simple summing circuit as shown in Figure IV-2 is required for the 


solution of the set of equations given by equation (IV-5), where 


P ae Re | b3| wit San) 
— — 
5 Re SBT (t) xTt9,t) F 


Rg | ba mat. 


Pe # ee 
oR, Brey Mtg, t)% 


and 


Res = feedback resistance, ohms x 10° 


1h 








FIGURE I7-i CIRCUITS FOR ADTOINT SET OF EQUATIONS 






=> 
—3,_ Sqn by Bc) Xt, t) ¥ 


T 
Ficuae IV-2 CiRcuiT FoR So.uTION oF ATL) XU, 14 = BZ 
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el —- = 





For the single input system 


(rv-6) || Bt) x7(t,,¢) | 








BT(t) x\tost) H| 

hence the absolute value circuit presented in Figure IV-3 was used 

to normalize the scalar quantity. To normalize a vector quantity a 
different scheme would be required. The absolute value circuit is an 
extremely accurate circuit. 

Now then 


t 


1 
(IV-7) Yeu | 


| Bl(s) xl(t 1) 7 | ds 
t 0 
0 
Solution of this equation requires a simple integrating amplifier, 
see Figure IV-l,, where 
P= RC 


A al(t) xM(to,t)% 


By putting the initial condition equal to + Gl - x(0) on the amplifier 
the function £(% ,23x(0)) can be obtained directly. To obtain the 
stopping time, run the system until 
£(4 ,23%(0)) = 0 

at which time switch to hold. Automatic hold switching was obtained 
throuch use of a relay as depicted in Figure IV-5. To insure accurate 
Switching, the voltages were read out to four decimal places, an 
adjustable input was supplied to the amplifier as shown in Figure Iv-5 
and stopping times which satisfied f( ¥) 523x(0)) = +0.0005 volts were 
accepted. 

Time was generated on a simple integrating amplifier with constant 
input. When the computer was run in reverse time the input voltage 
was reversed in polarity and the automatic hold circuit was switched 


to the output of the time generating amplifier. Again the system 


was automatically switched to hold at time t = 0. 


16 










Be) x,t) 


UB%e) Xe, t) al 


FiGURE IZ-3 ASSOLUTE VALUE CIRCUIT 


t:0 ,f.0.: 9°, 


were) Xe, 4) Fil 


t 
FIGURE TZ -4 CIRCUIT FOR SOLUTION oF §(}45-4,) > Justo de Oeil at 
() 
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The control signal was produced by taking the output of amplifier 
number 3, Figure IV-2, and feeding that into the bang-bang circuit 
presented in Figure IV-6. The potentiometer is adjusted to produce 
the voltage representation of the magnitude of the control signal. 
The voltage potential of two common outputs will be that of the most 
positive of the individual amplifiers. At point A the voltage will be 
the most positive value of 1) + saturation, 2) - saturation or 3) u = -1l 
which automatically eliminates 2) as a possibility, since if 
BI(t) X7(t4,t)% > 0, -1 > - saturation and if BI(t) X"(to,t)W < 0, 
+ saturation > -l > - saturation. Similarly at point B the voltage 
represents u = +1 for B!(t) x Gest) 4 yO. sor 1 = —1 for B’ (t) X1(to,t) y ici 
This is an extremely accurate circuit for which the voltage representation 
for u was set accurately to four significant figures. The switching 
time was determined to be less than 0.1 milliseconds for an input 
changing at the rate of 50 volts/sec which was chosen as a representative 
rate of change of the voltage representation of B!(t) XT(to,t) H. 
The circuits used to compute Z(t,,¥) were simple integrator 
circuits. First ¥( tz) was computed, see Figure IV-7, from 
(IV-8) Y= a(t) F¥+¥(t)u , ¥(0) = 0 
and then z(t, »7) was computed by integrating 
(Iv-9) WeA(t)wW 4 W(t,) = ¥t,) 
backward in time, see Figure IV-8, to yield 
(IV-10) 2(t,,%) = WO) 
To perform the backward integration, it was only necessary to reverse 
the polarity of all the inputs to the integrators used in the 
generation of yt) and remove the control signal input, all of 


which was accomplished by manual switching while in the hold condition. 
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FIGURE [V-6 BANG - BANG CIRCUIT 
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FIGURE DZ-& CIRCUITS FOR THE GENERATION OF dr (t) 
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In Figure IV-7, 





l 
a 
Py = RoCe Teal Xx 
h , Xt 
P RC >| 2 
10 lo yy Xt 
Jao X y 
ar “1, ey, XE : 
lage| 
eis t, Bee 
P Rc loo ox 
13° "13 F, Ayn Xt, 
and in Figure IV-8, 
a 
' | 1 
a 
Peer. | 12| SS We 
72 wy Xt 
= ROC |221| Xw 
16 16 FD Wo ct 
a 
| 29| 
Bn se an 
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Nig SPECIFIC PROBLEM SOLUTIONS 


Selected two-dimension as well as’ one three-dimension system were 
investigated for the rese"rch of this paper, The two-dimension systems 
investigated were: 


1) aneutrally stable system, * 


HT] 
Plat yt, 
4O 
ral 

+ 
o~ 
XH © 
oa 

(= 

we 
C 
IN 


2) a stable system, “x = | ~2 7 u | 
3) a lightly damped system , ¥ = | : i x + iS a) eu 
and the three-dimension system investigated was: 

em Oe 0 
lh) Romo) «+ 1O; n» , |u| <1 

0 "0's 0 if 

Plant 1) was chosen to provide a system on which a rather thorough 
analytic solution could be obtained in an effort to gain some insight 
into the problem solution. Plant 2) was chosen to investigate the 
effect of running a stable plant in reverse time, that is a stable 
and an unstable combination. Plant 3) was chosen as a representative 
two-dimension system for which solution might be desired. The three- 
dimension plant l) was selected to provide a simple extension of the 
computational procedure to higher order systems. 
Plant 1) 


The analytic solution to the control problem synthesis parallels 


the analog computer solution. Given 


(V-1) xX = E a x + {9} Tae ae a 
define 

> = O O as Eak _> . ae) 
ay j i : eee) = Us " 1 
where 
(V-3) Js ata t) 9), Ne eesti) =n 


a 





then 

. aN Se Se 
(v-h) EG metas) Woes. J = =,,¢ + 15 
from which 


(V-5) u = sgn (-1,,¢ + Tee, 


and t 
1. 
(V-6) at. J J-n 45+ Ny} 4s 
aL t ley a2 
) 
Referring to Figure V-l, for a and Ny0 of the same sign 
—_ paiks 2 
(6a) MN, -2- |npl t- ule. + <%p/Mn 


a aa 2 
(V-6B) YY °e=-|ny] t+ Maal + 5 Mae WS 


and for "1 and "45 of opposite signs 


2 
— = + 
(V-5 C) 7,°2- Mp l t+). +? 0 
Now 
(V-7) £(¥}45235x5) = 0 


=S x 
where Xo = x(0) = § 01} ,» defines the time t_ implicitly. From (V-6 A) 


02 . 2 af 
(V-7 A) +, = Mead = UMgal* + 2b tay! Oar X01 * Ma2% oe)” 


Maa 
from (V-6 B) . | : Fi 
+ = ns 2 
cet sy ge Maal * Maal? = Zl l Cnrvn + Maz%oe * Mae! Aaa!” 
; Mal 
and from (V-6 C) ; , 
tf + + 2 
(V-7C) t= “Imygl_ + yl * = 2lngl Cay * Maron * Maen!” 
: 3 | 
By definition + 
—> — i = 
(v-8 ) z(t,, >) .{ X(t.,8) B(s) sen (BI (s) x"(tos8) 7) ds 
but 0 
(V-9) X(0,s) = E i 


sie) 


—S vy it 
V-10 ci) = . d 
( ) z( ? Tee s a sgn ( Ya 3 + Wee s 
so that f € i 
O or tS ao) MRR and Y),, and ¥,, of the same sign 
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as = Se )/2 sgn (40) 
ea) a(t») fs {- t, sgn (41) 


for ty 2 “Iyo/%1yz» and 4, and 45 of the same sign 
: 2 = 
(V-10 B) Z(t, 513) = } A0%,)" S940 (m2) 4,."rM,) sgn es t% §gn Te 


MeAiy SG0 Cn) + Mem, 83nCny) =, sgn(n) 
and for “ha and "a0 of opposite signs 


(t.°)/2 sen (ay) 
a 1 Tal 
CV=10 0) ga 2 cans gels a sen (¥)3,) 


— 


Now 
(vein) a = ~(z(t4 5%) os) 
and 
V-12 i eel 
( ) ME ee 
so that 
> = 
(V-13) Lethal ee SAS ee Ae 


With this computational procedure, succeSsive values of 7) were obtained 
for At Sari. xa = sen - The data are presented in Table V-1 and a plot 
of Veo versus ual is presented in Figure V-2. From equations (V-7) it 

is apparent that ty is a function of only one variable. To gain a 

better understanding of the function F( Y i) on which the method of 
steepest ascent was used, it was decided to find F(f)) where P= alt Ya° 
Then for t, § Nao/ Np Ny 2nd Ny the same sign 

(Vly A) ty = P- ( P2 - a(x, + P xp) 

nor t12 Me! Vane Ya and Ny0 the same sign 

(Vel B) ty = P+ (=P? + 2(xQ) + Pxq9))? 

and for 41 and Yie of opposite signs 

(valle C) ty = Pape « 2(Xp, + ie Xo)? 

F(}) 1%p) was plotted versus / in Figure V-3. 

The effect of the size of AT was investigated by linearizing equation 


(V=13) about ae = 72} which was obtained from Figure V-3. Since Yu 
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and y,, < 0 and t, > Mix’ awe using equations (V-10 B) and (V-13) 


(V-13B) 4.7 { —L maf) — ean V-eadn)® + 2 Cho) + 1H, %y) + Ha] OT ty 

define cE (ne Mn.) + ~baAny)© + Bide Ye; Yor + br lat Palen 
> = acy on : ae 

(V-15 ) b= Neat - Me Ss ee 7 -¥° Ay, 





= = ~1 
then for Xo a ; n° = (a 


(V=16) S$ =A A> 


where 

: EV NGy Ss 2 ae | aA ae 
oo!) - 2A (l= Z2AT ) 
The eigenvalues of A are 
(V~18) Ae1,1-hAt¥ 


For stability, Ir, | < 1, hence for the given plant with X = a 
AT < 0.50 gives stability. As noted in Table V-1 and Figure V-2 
with AT #1 there is a slight divergence in the successive values of 
y as y° was approached. ‘ 

Using the circuitry presented in Section IV as combined in Figure V-h, 
the computational procedure was investigated for values of AT = 1.0, 
C2375, 0.25 and 0.1 with Xp = in . The data for the iterations are 
presented in Table V-II and are plotted in Figures V-2, V-5, V-6 and V-7 
respectively with the corresponding analytically computed iterations. 
As expected AT = 0.25, A = 1 and O, yielded the most positive convergence 
to Wes At = 0.375 gave rapid convergence with some oscillations, 
AT = 0.1 gave slow convergence and AT = 1.0 gave large oscillations. 
The hill climbing pattern associated with each value of AT is presented 
in Figure V-8, It was noted in Table V-II that as xX —> 0, the correction 
vector (2(t,,%}4) = x,) AT ——> 0 independent of the choice of At. The 


plots of x, (+t) versus x, (+) are presented in Figures V-9, V-10, V-11 and 
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V-12 respectively to indicate the relative error in x(t, ) for successive 
iterations of i e The initial choice of "a = a on the boundary of 
34 - x(0) = Owas chosen for AT «1.0, for AE = 0.25 and 0.375, 
Y). Xx 0 was chosen and for AT =0.1 7) was arbitrarily chosen 
al |x(0)| 3 1 e 
There was no apparent effect due to this limited choice of initial values 
—_ 
of Ny: 
The plant was further investigated for another given initial state, 
x(0) = a omeine plot of F(Y Fo) versus / is presented in Figure 
V-13. Again the difference equation (V-13) was linearized about 
-1,000 nae 
y os ie. es giving 
Se (SOeDOB,AT oa0i1) 1.198 AT ® 
(v1?) é iLAA Ney E2207 At + 1) ay 


so that A has the eigenvalues 

(V~20) ie= lol =e Ss A 

Analytic and computer computations for AT = 0.1 and 1.0 were made and 
the data are presented in Table V-III and displayed in Figures V-1l and 
V-15. The hill climbing patterns are presented in Figure V-16. Again 
QT = 1.0 gave oscillations while AT = 0.1 gave slow convergence, and 
as before as x(t,) —> 0, the correction vector, -(2(t, 1) + XAT a 
independent of the choice of AT. The plot x, (+) versus x, (t) is 
presented in Figure V-17 for AT = 1.0 to display the relative error 


in x(t, ) for successive values of iy 
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The computer was set up as shown in Figure V-18 using the basic 


Gircults of Section LV for 
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to determine the effect of computing solutions through different multiples 
of the system time constant. 

For x(0) = os » AT = 0.5 and 1.0 were used. The data are 
tabulated in Table V-IV. Plots of Nao versus Ns1 are presented in 
Figures V-19 and V-20, the x5(t) versus x(t) plots are presented in 
Figures V-21 and V-22, and the plots of yo(t) versus y,(t) and wo(t) versus 
w (t) are presented in Figures V-23 and V-2h to indicate the range of 
yt) and w(t) in the computation of a(t, ). As was the case with Plant 1), 
AT = 1.0 gave some oscillations and relatively slow convergence, whereas 
At = 0.5 gave much more rapid convergence and eliminated much of the 
oscillations. Again it was noted that as x(t) —> O, the correction 
vector -(Z(t4,%) + 2 Age — > 0 independent of the choice of AT. 

For x(0) = oo » the choice of AT was dependent upon the 
criterion |AW,,,| < |A¥,| - The data are tabulated in Table V-Iv, 
the yo versus Ni1 plot is presented in Figure V-26. Using this criterion for 
the selection AT rapid convergence with some oscillation was obtained. 
Again as the state vector X(t, ) —> 0, the correction vector 
-(2(t,,4) +X_) AT —> 0. 

For x(0) = Por the choice of AT was dependent upon the criterion 
AY i41 : AY i> 0. The data are presented in Table V-IV, the go 
versus Y).4 plot is presented in Figure V-27, the x, (t) versus x, (t) plot 
is presented in Figure V-28 and the plots of y(t) versus yz (t) and w,(t) 
versus w, (t) are presented in Figure V-29. It is noted from Table V-IV 
that the additional requirement that y 2s < O was used in the selection 
of AT, hence using the finite difference equation it does become 


possible for Y to leave the domain. In Figure V-29 it is noted that the 
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range of y(t) is much smaller than the range of w(t). Any noise in the 
system would have a more pronounced effect on F(t) resulting in errors 
in y(t, ) and hence in Z(t,). This could possibly explain why 
-(z(t, 7) + Soe: O as x(t, ) —> 0. This problem, or source of 
probable error, could be minimized by rescaling the amplifiers used to 
compute y(t) and w(t) when switching from forward time to reverse time, 
or by using separate amplifiers to compute the two functions. 

The only analytic work performed for this plant was the computation 
of the time ay and the results are presented in Table V-V. As can be 
seen from the table, there is good agreement in all cases between 


the analytic and computer values of the time th. 


Table V-V 


Comparison of Analytic and Computer Values of the Time ty 





Plant 3) 
The computer was set up as shown in Figure V-30 using the basic 


circuits of Section IV for 


(V-21) x = 3 : z+ fol u,luf<1 
Initial states of x(0) = iA P Ss » and ist were selected to 


provide systems requiring differing numbers of control signal switching. 
The criterion used for the selection of AT was NG ° A. Pao 
for all three initial states. The data are presented in Table V-VI, 


the plots of “ao versus ‘e1 are presented in Figures V-31, V~32, 
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and V-33 respectively for the three given initial states and the plots 
of x5(t) versus x(t) are presented in Figures V-~3h, V-35, and V-36. In 
all three cases the convergence to Me was rapid and x(t,) and 


—_> at ae ° => 90 
(z(t, 5%) + X,) were of the same order of magnitude as H —> W°% 


Plant h) 
The computer was set up as shown in Figure V-37 using the basic 


circuits of Section IV modified for the three-dimension system 


aes a ae 
(V-22) gO 0 daiax+ 708 ume |u| < 2 
* Gnome i 
x(0) = | was the initial state which was investigated. Initially 
il} 


the criterion for the selection of AT was that AY), ° Ay; > O; 

aa (are 
however, after seven iterations it was decided to use as the criterion, 
AG me which would yield ae > ie .» Using this criterion, a total 
of sixty iterations were completed at which time x(t) > 0 and 
z(t) > -x(0). The data for iterations fifty through sixty are 
presented in Table V-VII. There was no apparent pattern for the selection 
of AT. In all iterations it was possible to duplicate values of ty 
for successive re-iterations with the same comouter parameters; it was 
not possible to duplicate values of Z(t, )- With this in mind some error 


analysis work is indicated to détermine the effect of an error in Z(t), 


introduced by some random signal, has on the convergence to Y o. 
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VI. SUMMARY OF RESEARCH RESULTS 


The optimum control law for two-dimension systems is readily 
obtained using Neustadt's synthesis technique as adapted to analog 
computer solution. For the solution of three-dimension and higher 
order systems some refinement of the computer technique used in this 
research is necessary. 

The initial choice of 7H has relatively little effect on the 
convergence to the optimum steering order. There are a wide variety 
of criteria for the selection of At which in general lead to 
satisfactory results for the twoedimension system. For design 
of an automatic system perhaps the criterion that A tae Sass me > 0 
would be the best suited. In general large values of AT give slow 
convergence with large oscillations about ¥° while small values of 
AT give slow positive convergence. There obviously are some AT 
which give the best convergence but no optimization was attempted 
in this research work. 

Using the finite difference equation in computing iterative 


values of y it becomes possible for Y to leave the domain. 


CM 





VII. POSSIBLE EXTENSIONS OF THIS RESEARCH WORK 


1. The natural extension of this work is to continue on into 
the third and higher dimension systems. 

2. A significant extension of this work would be the optimization 
ef AT. 

3. An error analysis of the effect random errors in the computation 
of z(t,) has on the convergence to YW ° would be noteworthy. 

lh. To be of maximum use the system must be fully automatic, 
utilizing logic circuits, and/or a digital-analog combination which 


subject requires some investigation. 
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